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ABSTRACT 


Cumulative search-evasion games (CSEGs) involve two plavers, a searcher and an 
evader, who move among some finite set of cells. Neither plaver is aware of the other 
plaver’s position during any stage of the game. When the pavoff for the game is as- 
sumed to be the number of times the searcher and evader occupy the same cell, Eagle 
and Washburn proposed two solution techniques: one by fictitious play and the other 
by solving equivalent linear programming formulations. However, both have proved to 
be time consuming even for moderately sized problems. 

This thesis considers two alternate linear programming formulations for CSEGs. 
Since both contain a large number of variables and constraints, the linear programming 
problems are initially solved with many of the constraints removed. If the solution to 
this relaxed problem is not a feasible optimal solution, additional constraints are added 
and the problem is solved again. This process continues until a feasible optimal solution 
is found. The results from a numerical experimentation with various solution techniques 


are also presented. 
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I. INTRODUCTION 


Cumulative search-evasion games (CSEGs) involve two players, a searcher and an 
evader, who move among some finite set of cells, C. Neither player is aware of the other 
plaver’s position during any stage of the game. Let X, and Y, represent the positions 
of the searcher and evader, respectively, at time t. If the cells are numbered from | to 
n, then X,=i and Y, =j for some ij € {1,2,....n} for all t. The pavoff of the game, N. is 


given bv 


. 
ve YAWY.Y 0 (1) 


where T is the number of time periods and A(X,. Y,.t) is the payoff function. The 
searcher wants to choose his strategy so as to maximize the expected payoff, ETN]: the 
evader desires to minimize the expected payoff. While there are many other suitable 
pavoff functions, the one of interest is an indicator of the event X, = Y,. In this case, 
the pavoff is equal to the average number of times that the two plavers occupy the same 
cell simultaneously. 

This study assumes that the starting positions for both the searcher and the evader 
are specified. In particular, let S, and FE, denote the starting locations (cells) of the 
searcher and evader, respectively. From one period to the next, both plavers are allowed 
to only move to cells which are adjacent to their currently occupied cells. In ume period 
t. let the sets S(X,.t) and E(Y,.t) denote the cells which are adjacent to X, and Y,. then 
X,-,; and Y,., must belong to S(X,.t) and E(¥,.t), respectively. Figure | displays a one 
dimensional CSEG with four cells. If X,=3, then X,., must belong to S(N,.t)= (2, 3, 
4}. In essence, the plavers are not allowed to “leapfrog” to non-neighboring cells in one 
time period. Eagle and Washburn give several applications for CSEGs [Ref. 1]. 

Note that the objective function in a CSEG is not the probability of detection. In 
most search theory. the measure of effectiveness (MOL) to be maximized 1s the expected 
probability of detection. This MOE is most often given as E[! —e*%], where N is as 


defined as above and A(X, ¥,.t) is interpreted as the detection rate at time t. (See 











Figure 1. One Dimensional CSEG -- Motion Feasibility 


Koopman{Ref. 2 ].) Since E[]1—e%] # 1—e-#™, the CSEG solution cannot be in- 
terpreted as a detection probability except when N is very small (Eagle and Washburn 
[Ref. 1}). 

Most search theory deals with the optimal allocation of a searcher’s effort to detect 
a target which is not allowed to actively evade. Most approaches (see Stone [Ref. 3]}) 
rely on Bayesian methods for finding optimal search plans. Stone [Ref. 4] also surveys 
an extensive literature for finding optimal search allocation where the searcher is un- 
constrained and target motion follows a Markov process. Eagle (Ref. 5} and Stewart 


{Ref. 6 ] have studied the problem where the searcher is constrained. 














Gal [Ref. 7] and Ruckle [Ref. 8] have considered games in which the target has 


been allowed to actively evade, using “time unul capture” or “time until first detection” 
as the pavoff. Stewart [Ref. 9] studied optimal search and evasion strategies for a two 
cell model under various constraints. Stewart's study assumes a detection rate payoff 
funcuon which makes the analvtical solution difficult for even the small model consid- 
ered. CSEGs are thus an improvement on models such as Stewart's in the sense that 
games with several cells can be considered. ‘The price paid for this is that CSEGs require 


a specific, analytically convenient form for the objective function. 











Hl. EAGLE-WASHBURN FORMULATION 


Eagle and Washburn [Ref. 1] offered two methods for solving CSEGs. One method 
is the Brown-Robinson method of fictitious play [Ref. 10]. The other approach is for- 
mulating the CSEG as a linear programming (LP) problem. Similar to the normal 
method of LP solution, there are two linear programming formulations: one for the 
searcher and the other for the evader. Both are equivalent in that they are duals of each 
other. However, unlike the normal method, where each pure strategy has a decision 
variable and a payoff matrix must be computed, this formulation is expressed in terms 
of marginal probabilities of the searcher occupving the cells in each time period t. The 
main motivation of this formulation is to avoid generating all possible pure strategies for 
both the searcher and evader. The number of pure strategies grows exponentially as a 
function of the length of the game, T, and the number of cells in S(X,, t) and L(Y... 
For example. for a one dimensional search problem with 20 time periods and S(X,.t) and 
L(Y.) each containing three cells for each time period, there are 3° pure strategies for 
each plaver. 

To formulate the linear programming formulation for the searcher, Eagle and 
Washburn define the following: 

pli.t) = the marginal probability that the searcher occupies cell i at time t 


ulij.t) = the probability that the searcher will visit cell i at time t and cell j at time 
t+ 1 


7(j.t) = the smallest possible pavoff accumulated from period t to period T given that 
the evader occupies cell } in ume period t 


S‘(i.t) = the set of cells in time period t-1] from which the searcher can reach cell 1 in 
time period t. That is, 


S*(it) = {ke Clie S(k.t— 1)} 


ior ieC and t= 2.3,...,T, where S(k,t-1) is as previously defined. For example, in Figure 
1 Scltt+1) = 1. 











Then, the linear programming problem can be stated as fcllows: 
max 2(£.1) 
subject to 
P(Sp.1) = 1 


= y" u(t, — 1) + oy ulikt)=0; 16 C, 1=2,3,...,T7—1 
ya) 
Je S09 ke Suit) 


ke S(Sp.1) 


_ Ss! ui —1)+ pli) =O, fe C 


— SAlijaplin = (ht +1) + tit) $0; Je C, ke EU), t= 12 a Tt 
ieC 


— SALA TIAT) + UT) =0; 1€ C 
a 


hed 


Ui SO ye O. c= ONL, T-1 


(6) 


(8) 


The objective function above corresponds to maximizing the numimum pavolf for 


the searcher given that the evader starts in cell E,. Constraint (2) then restricts the 
g 0 


searcher to start in cell S,. To vatidate constraint (3). Eagle and Washburn observed 


that for ieC and t=1,2.....T-1, 


pis) = » u(ij.t) 


JES 


or, alternatively 


(9) 








pit) = » uit — 1). (19) 


je SUD 


Then. constraint (3) essentially enforces the equality of two equivalent expressions, (9) 
and (10), for p(i.t). There is also a network interpretation for constraint (3). Figure 2 
depicts the network interpretation for a one dimensional CSEG with three cells and three 
time periods. The node (1,t) in the network represents cell 1 in the time period t and the 
flow on an arc connecting node (i.t) to (j,t t+ 1) is represented by u(i,j.t). Then, constraint 
(3) is simply the conservation of flows at each node (i.t). Constraints (4) and (5) repre- 
sent the terminal conditions for pU.t) for t= 1 and t= T, respectively. 


Based on the definition, z(j.t) can be written as 


yh aa 
“n= > Aoi) + min 2A + 1) 1) 
vy) a (0p) pelle } ( 


where 2(«,T+1)=0. Constraint (6) 1s simply the linear representation of equati n (11). 
Similar to constraints (4) and (5). constraint (7) is the terminal condition of equation 
Chink 

The linear programming formulation for the evader is the dual of the above and is 
not presented here. The reader is referred to Eagle and Washburn [Ref. 1] for the de- 
tails. However, it should be pointed out that the above formulation still contains a large 
number of decision variables, which in turn contributes to the extensive CPL time re- 
quired to solve even a moderately sized CSEG. Most of these variables are u(ij.t) Vari- 
ables. One objective of this thesis 1s to model the searcher’s problem without these flow 
variables. 

For the one dimensional CSEG, the tormulation contains (3n-2)T flow variables and 
nf smallest pavoff (zU.t)) variables. (Marginal probability (p(1,t)) variables can be cal- 
culated from u(i.j.t) variables: they are not needed to solve the LP.) The number of 
constraints needed 1s approximately (4n-2)1 + 2n. 

The game reaches equilibrium when both searcher and evader marginal! probabilities 
are uniform over cells 1,2,....n. It can be shown that once the p(e.t) and q(+.t) reach this 


distribuuon. these distmbutions are optimal from that time onward (Eagle and 








u(1,1,1) 






u(2,3,2) 





—_— 










(it) indicates cell i in time period t 


Figure 2. Network Flow Interpretation of a One Dimensional CSEG 


Washburn [Ref. 1]). In order for the game to reach equilibrium, it was found by ex- 
periment that T = 1.5n. Thus, the Eagle-Washburn formulation requires on the order 
of 6n? variables and constraints. 

In the next chapter, two alternate linear programming formulations are considered. 
Both formulations contain fewer decision variables and many more constraints than the 


Eagle and Washburn formulation. However, the main advantage is the fact that many 











of the constraints are nonbinding. Thus, the problem size can be controlled by initially 


solving the linear program with only a small subset of the constraints and iteratively 


adding new constraints and resolving as necessary until an optimal solution ts achieved. 

















Hil. METHODOLOGY 


The Eagle and Washburn formulation always produces an exact solution for 
“SEGs. However, as the size of the problem grows, the time to solve the LP grows even 
more rapidly, making it impractical for solving large CSEGs. This chapter considers two 
alternate LP formulations based on preliminary work by Washburn and demonstrates 
how to solve these formulations in an iterative manner. 

To simplify the presentation, only one dimensional CSEGs are considered. Also, it 
is assumed that 

]. The search area consists of n cells. 

2. The game is plaved for T time periods. 
3. The searcher occupies cell 1 at time I. 
4. The evader occupies cell n at time I. 


. The searcher and evader are each allowed to move one cell left or right or remain 
stationary at each time step of the game, Le., 


‘ay 


{1.2} i=] 
Sin = Ei =<fi-Lirt tT} f= 2.3..0-1 
{n— Ly} i=n 


“. METHOD ONE 
Let q(j.t) be the marginal probability that the evader will be in cell j at ume t. Then. 


the expected pavoll, v. is given by 


a 
r= ALN = > Yt inpli.nguin (12) 


t=1 ijeC 
Where p(it) and N are as previously defined, A(ij.t)= 1 iff i=j and EEN] denotes the 
expected value of N. The searcher wishes to maximize the expected pavoff and the 
evader wishes to nunimize the expected pavoll. 
Given that the marginal probabilities, p(i,t), are specified by the searcher, the evader 


then wants to find a strategy to minimize the payoff of the game. Let 


Y= {¥,.Y3...¥,} be a feasible evader path or “track”. If v represents the value of the 








game, then the following must hold for all strategies Y and marginal probability dis- 


tributions pU.t). 
T T 
r< SSG, Y,.OpU0 ye: (Y.0) (13) 
ad od 


where the equality follows from the fact that AG,Y,.t)=1 iff i= ¥,. Based on (13), the 


first alternate formulation can be written as 


max v 
subject to 
Vipin = eS ck : (14) 
i=] 
A 
\ < ) pha) ¥ } (1S) 
(41 
Yn jo< y pata Ve k= hla tekken, PS 23d (16) 
£ joPol 
pire Vets lawl Slat (1%) 


Constraint (14) ensures that the marginal probability must sum to one for cach time 
period and constraint (15) enforces the optimality condition expressed by equation (13). 
Finally, constraints (14) and (16) guarantee that there exists a corresponding set of fea- 
sible u(ij.t). To illustrate that this is true, consider the CSEG with six cells and let h= 2 


and l=4. Then, constraint (1G) translates to 
Pwo + pb. + plan) < pled) + pel + pbs 1) + pid 1) + pba 1 


Which simply imphes that the probability that the searcher will occupy cells 2, 3 or 4 at 
time t must not be larger than the probability that he will occupy cells 1, 2, 3, 4 or 5 at 
tume t-l. If this condition does not hold, there can not exist a corresponding feasible 
“transition” probability. u(ij.t). In the network interpretation. constraint (14) ensures 


that the total “supply” leaving nodes (1.t-1) and the total “demand” arriving at nodes (1.0) 


10 














for 1= 1,2,...,n 1s equal to one. Constraint (16) ensures that the amount of probability 
“shipped” along the arcs cannot exceed the “supply” of probability available. 

Even for a moderately sized CSEG, the above formulation contains an extremely 
large number of constraints, in particular those which are described in constraints (15) 
and (16). Thus, it would be prohibitive to generate all the constraints and solve the re- 
sulting LP. Instead, the algorithm below initially solves the problem with one strategy 
Y= {nnn}. Le., the evader remains in cell n for all T time periods, and disregards all 
type (16) constraints. Afterward. the violated constraints are added iteratively until all 
binding constraints are included in the formulation. The algorithm can be stated as 
follows: 


Method One Algorithm 


Step O: Set k=0 and let (1°, p°U.4) solve the following 


LP(O?: 
max ¥ 
subject to 
y pid) ir ee ean ee (18) 
2 
Vs bare t) (19) 
=] 
pion >o, i= 12 o= 1,20..7 (20) 


Step 1: Tf (4. pp’) is feasible by constraint sets (15) and (16). then (7. poids is a 
solution. Otherwise, go to Step 2. 


Step 2: Generate constraints from the constraint sets (15) and (16) which p‘(i.t) vio- 
lates and add them to problem LP(k) to obtain a new problem LP(k+ 1). 


Step 3: Let GQ?) pin) solve LP(K+ 1), set K=k+1 and go to Step 1. 


In Step 2. the feasibility of constraint set (16) is tested from level 1 to level n-2 for every 
ume period until an infeasible condition is found or the solution can be declared feasible. 
The level refers to the number of cells considered. For example, the level 1 feasibility test 
consists of ensuring that pit) < p(-lt-l) + p(.t-l) + pat d.t-l) for ieC and 
t=2.3.....7, where p(0,*) and p(n+ 1.«) are detined to be zero. If this test is violated, a 
constraint of type (16) 1s added to the linear program for every such violation of level 1 
feasibility tests and the LP is solved. If no violation is found, level 2 feasibility tests are 


performed. These tests ensure that p(t) + pat Lt) < pa-Lt-1) + pa.t-b) + pat hte 


1 











+ p(it2,t-1) for i= 1.2,....n-1 and t= 2,3,...,T. where p(0.e) and p(n+ 1,¢) are defined to 
be zero. These tests continue until a feasibility violation is found and the necessary 
constraints added or until the solution is found feasible. The number of these con- 
straints could potentially grow as large as sLaack 1)T, but only a fraction of these con- 
straints are needed. : 

Then, to test for feasibility for constraint (15), find a track, 7 , for the evader such 
that the sum of all p(Y ut) over all t is a minimum among all tracks. This can be ac- 


complished by solving an appropriate shortest path problem. If 


rT 


Spl Yt) < vt (21) 


(=) 


then constraint type (15) is violated and the constraint 


is 
r< yp 22] 
t=] 


must be added. 

Method One was altered in two ways to attempt to reduce computation time. One 
variation involved eliminating slack constraints. Since each successive LP is larger than 
the previous LP, the time to solve cach LP grows. By eliminating constraints that re- 
main slack for several successive LP solutions, the overall size of the LP is reduced. 

The other variation involved starting With a set of path constraints. or type (18) 
constraints, in addition to the usual starting constraints. If these path constraints can 
be chosen so as to cover the critical paths (path constraints that are tght in the final 
solution), this may reduce the number of algorithm iterations necessary to urrive at the 


problem solution. 


B. METHOD TWO 
The second method is similar to the first method. except that constraint set (15) is 
replaced by the recursive definition of the 2(+,*) variables stated in Chapter IT. Using the 


fact that A(t) = 1 iff i = j, 2(+*) can be redefined as follows: 


240 = plit) + min z(Aa t+ 1) (23) 
Felis 














where z(-.f+1)=@. Both types of constraints serve the same purpose: to ensure that 
the g: me value is equal to the minimum payoff possible for a given p(e.). However, 
constraint set (15) was added as needed, while constraints corresponding to equation 
(23) are all in the inital LP. The advantage of the method is the fact that equation (23) 


produces (3n-2)T constraints while constraint set (15) contains 3°. 


Method Two Algorithm 


Step 0: Let k=0 and (1°. p*(i.1)) solve the following 


LP. oO): 
maxr 

subject to 

V pit Blor=1.2.7 (24) 
vere 

i=! 

ys lll) (25) 
clit) SoU + LI) + pli) G= 12,000 pe Bg. t= 1,2,..07- 1 (26) 
rid) SOs alan, be LE (27) 


Step bs If te. pic) is feasible to constraint set (16), (*. p*(47)) is a solution. Other- 
Wise, go to Step 2. 

Step 2: Pind cons:raints of type (16) which are violated and add them to problem 
LPck) to obtain a new problem LP(kK+ 1). 


Step 3: LetQvch po 'tan) solve LPtk+ 1), set K=k+1 and go to Step I. 


Note that the method for finding violated constraints in Step 2 is as described for 
Method One. 

Method Two was altered in two ways in an attempt to reduce computation time. 
The first variation was the method of eliminating slack constraints as done with Method 
One. The second variation made was adding a group of motion feasibility constraints, 
1e., constraint set (16) to LP(Q). This variation is similar to the second variation on 
Method One. If this group of motion feasibility constraints is chosen so as to cover 
those motion feasibility constraints which are tight in the solution. the number of algo- 
rithm iterations may be reduced. The method devised for choosing motion feasibility 
constraints for the starting group was drawn from examination of CSEG solutions ob- 
tained through the use of Method Two. This method proved very successful and is de- 


ecribed below as Method Three. 


13 

















C. METHOD THREE 

Method Three is essentially the second variant of Method Two. except that the 
performance of Method Three is markedly better because it does not require successive 
iterations to arrive at an optimal solution. An examination of the tight motion feasi- 
bility constraints in optimal solutions using Method Two reveals that all these motion 


feasibility constraints are of the form: 


{ (+) 
Sinus Split — Ns f= LQ 2 (28) 
i=1 j=) 


All these constraints include cell 1, the left-most cell. These constraints will be referred 
to as left-anchored constraints. 

Another observation from previous solutions is that the searcher alwavs rushes from 
cell | to cell 6-1 during the first @-1 tme periods where t=@ is the first time period in 


; ; : n 
which the searcher and evader can cu. cide. When there are n cells, 6= | + | when n 


~ 


; n :; 
is odd and @=—-+ I when nis even. Here [x] denotes the smallest integer m such that 


xm. Since the searcher and evader cannot occupy the same cell during these first @-] 
tuume periods, A(A,, Y, .t)=0 for t= 1,2....,@-1 for any pair of searcher and evader strate- 
gics (N.Y). Thus, no pavoff occurs during periods | to @-1 and 2(n.1) must be the min- 
imum of z.@) where i=@,4+ 1,....n. This observation allows for ignoring all those 
decision variables from the first 0-1 time periods. This reduces the number of variables 
and constraints by approximately one-third. 

Use of this formulation with left-anchored motion feasibility constraints will solve 
CSEGs as large as n= 12. In larger CSUGs, there exists another set of tight motion 
feasibility constraints which are anchored on the right-most cell. cell n. For thése 
CSEGs, inclusion of this set of constraints for the last few time periods leads to an op- 


umal solution. If we let t = the first time period in which the right-anchored motion 











feasibility constraints are required, then the LP is as follows: 


max + 
subject to 
Rare Hl r=@,041...7 (29) 
i=! 
ios 2Ut I+ ple = 6,041.7, (= 1.2...,0, fe Elin (30) 
ret.) f=nt+)—-—An4+2-@..n (31) 
i i+] 

Sips Split =e = 0 $10 tal, (= Lat 2 (32) 
Wien s Yt —|l)i t=uttl.od d= aan 1,....3 (33) 
ixi j=l-} 
Puig 2 Oi= bw, 6= 127 (34) 


where 2(¢,T+1)=0. Constraint (29) ensures the marginal probability summed over all 
cells in a time period is equal to one. Constraints (30) and (31) perform the same func- 
tion as equation (23). Constraint (32) delineates all levels of left-anchored motion fea- 
sibility. constraints for time periods of interest. Constraint (33) describes all 
nght-anchored motion feasibility constraints for time periods of interest. The number 
of variables 1S nT + ] and the number of constraints is on the order of Sn. Assum- 
ing T= =n there are approximately n? variables and 4n? constraints. This formulation 


provides solutions for CSEGs up to at least size n= 30. 


— 
"sy 


IV. RESULTS 


Methods One and Two were both implemented through the use of a FORTRAN 
interface with LINDO (Linear Interactive Discrete Optimizer). Method Three and the 
Lagle-Washburn model were implemented in GAMS (General and Algebraic Model 
Solver) using MINOS (Modular In-Core Nonlinear Solver). All methods were executed 
on an IBM 3033AP mainframe computer at the Naval Postgraduate School, Montercy, 
California. 


A. METHOD COMPARISON 

Method One and its variants performed considerably worse than the Eagle- 
Washburn model for n > &. Figure 3 shows computation time in CPU seconds versus 
CSEG size for both methods. Method Two is shghtly faster than Method One. but does 
not perform as well as the Eagle-Washburn model for n > 10. In Figure 4, 2-f indicates 
the performance of Method Two and 2-2 indicates the performance of the Method Two 
variant with slack constraint elimunation. 

Using Methods One and Two for solving larger CSEGs results in excessive compu- 
tation time due to the increased number of LPs that must be solved. The strategy of 
solving several smaller LPs instead of one large LP fails because of the large number of 


small LPs that must be solved to arrive at the problem solution. 
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Figure 3. Computation Time of Method One vs. Eagle-Washburn Method 
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Figure 4. Computation Time of Method Two vs. Eagle-Washburn Method 


Method Three proved to dominate the Eagle-Washburn model tn all cases tested 
(n < 30). Figure 5 shows computation times for various size CSUG solutions under 


both models. Method Three allowed for solution of larger CSEGs than was previously 





econonucal using the Eagle-Washburn model. Solutions of these larger CSEGs have 


similar structure to smaller CSEG solutions, while showing some small differences. 





Computation Time 





E-W Method 


600 





CPU Seconds 


400 





Method 3 


12 
CSEG Size, n 






Figure 5. Computation Time of Method Three vs. Eagle-Washburn Method 
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B. CSEG SOLUTION STRUCTURE 

Our concentration has teen on finding the optimal searcher and evader marginal 
probabilities from the sturt of the game until the marginal probabilities reach equilib- 
rium. The strategies of both plavers have been described previously by Eagle and 
Washburn (Ref. 1] for one-dimensional CSEGs as large as n=12. Strategies in the 
larger gumes do not differ greatly fron: those in smaller games. 

One pure strategy that nught be advantageous to the evader includes staving in cell 
n until the searcher can reach that cell. If the game were plaved for less than n time 
periods, this would be the optimal strategy for the evader. since it would ensure a zero 
pavolf. However. for longer games, this strategy is not optimal because of the large 
pasolT the searcher can force when t =n. This strategy of waiting is part of a larger 
group of strategies that can be called “wait-and-run” strategies. The evader stavs in cell 
n. or waits, for k time periods, where k= 0.1.2... After he has waited k time periods, 
he moves to the left at top speed, one cell per me period, until reaching the left-most 
cells. 

Pigures 6 and 7 show that the ©.. ser muxed strategy consists of several “Wait-and- 
run” pure strategies. If we interpret the probabilities as being parts of a large force, such 
as soldiers in an army, we can explain the results as follows. Note. in Figure 7, how 36 
units break off immediately from the main force of J000 units in the second time period. 
These 36 units continue to move left at the rate of one cell per time period until reaching 
cell | at time 20, This strategy corresponds to waiting zero time periods before running. 
Other “wait-and-run” strategies are used. In each successive period, the size of the farce 
which breaks off from the main force in cell n increases. A large portion of the evader’s 
force remains in cell n through the time period in which the searcher first arrives in cell 
n-1. At this point, the evader disperses this force from cell n as quickly as is feasible over 


the next few tme periods. See Figure $ for details of this strategy on an expanded scale. 
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Figure 7. Evader Marginal Probabilities (x1000) for 20-Cell CSEG. 

















100 















Figure 8, Evader Strategy ~ Final ime Periods 


AS the forces Who ran ; 


» they join With the force 
those who Tan before. Note j 


s already: the 


TC, he, 
8 how the Number Of forces Teaches a Peak 





and then flattens out. Since both plavers can have forces in all cells at this point, the 
evader essentially disperses his forces to reach a uniform distribution over all cells. 

Instead of using the individual soldiers interpretation, the explanation can also be 
made in terms of the probability of choosing a pure strategy from the optimal mixed 
strategy. The evader chooses from a number of “wait-and-run” strategies. It is more 
likely that he will wait for long periods of time before running than running earlv in the 
game. After reaching the left-most cells, it appears the evader’s motion becomes more 
random as he spreads out towards a uniform distribution. 

The searcher begins the game by rushing, or moving right at top speed, one cell per 
time period. His optimal strategy always consists of rushing over the first @-1 periods 
where @ = the first time period in which the searcher and evader may occupy the same 
cell. Consider the five cell CSEG where the searcher begins in cell 1 and the evader be- 
gins in cell 5. Two time periods later. t= 3. the searcher could travel as far right as cell 
3, while the evader could travel as far left as cell 3. Thus, for the five cell CSEG, @= 3. 
This first possible mecting point is cell [4] when n is odd and cell 2+] when nis 


5 


- 


even. The searcher gains nothing by stalling during these first time periods: for every 
ume period he waits, he extends the number of zero payoffs he will receive. 

During some ume period (@ for CSEGs where n is even, @+1 for CSLGs where n 
is odd), the evader could for the first time be in a cell to the left of the searcher. For 
example, consider the six cell CSEG. At time 4, the searcher could be as far right as cell 
4. the evader as far left as cell 3. Ifthe plavers occupy those cells when t= 4, then during 
time 3, the searcher and evader were in cells 3 and 4, respectively. Thus, at ume 4, the 
searcher must split his forces between cells 3 and 4 to ensure that the evader cannot pass 
by without coincidence. This split of searcher forces arises in all CSUGs. 

To return to using the analogy of individual soldier movement, after this initial split 
16 made, the majority of the searcher’s forces continue rushing towards cell n, while small 
forces split from this majority at every time step. See Figures 9 and 10. These small 
forces travel back towards cell 1, much as the evader’s “Wait-and-run” forces do. These 
small fractions of the searcher’s forces make sure that the “wait-and-run” forces of the 
evader do not break through without paying some penalty. As with the evader’s “wait- 
and-run” forces, the searcher’s small split-off groups increase in size as the searcher nears 
cell n. Like the evader, once the searcher reaches cell n, he also disperses this main force 
as quickly as feasible. The forces then tend to move towards the uniform distribution. 


See Ligure LI for an expanded view of the searcher’s strategy for the final time periods. 
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Figure 10. Searcher Marginal Probabilities (x 1000) for 20-Cell CSEG. 
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Most often, he will continue to rush towards cell n. Sometimes, with a small probability, 


he will turn back and rush towards cell 1. At each time step, the searcher makes a de- 
cision on Whether to reverse motion; each tume the probability of reversing direction in- 
creases. Once the searcher has reached cell n (if he has chosen this strategy), his strategy 
is similar to the evader as both spread towards a uniform distribution over all cells. 
Another striking point of the optimal solutions 1s the tendency of neighboring p(i,t) 
and q(i.t) values to be equal. These groups of equal value come most often in pairs; 
towards the end of the game. they come in larger groups. This is most easily seen in 
Figures 7 and 10, the tabular displavs of searcher and evader probability distributions 
for the 20-cell CSEG. Although there are exceptions, these exceptions probably result 
from arriving at an alternate optimal solution. In working with small CSEGs that ex- 
hibit this excepuon, adding additional constraints to force equality among neighbors 


results in an alternate optimul solution. 











V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 
The formulation of Methods One and Two was intended to reduce computation 
time in two wavs: 


1. Reducing the number of decision variables by using marginal probability variables 
(pu.t)) instead of probability flow variables (u(ij.t)). 


2. Reducing the work required to solve the game by reducing the number of con- 
straints. 
The switch to marginal probability variables reduces the number of variables needed to 
define the searcher’s strategy by two-thirds for the one-dimensional game. A higher 
fuctor Would apply in the two-dimensional game. However, the iterative method of se- 
lecting constraints for successive LP solutions proved to drastically increase the compu- 
tation time necessary to solve larger games, 
Inspection of the results obtained from various sizes of CSEGs solved with Methods 
One and Two led to the formulation of Method Three. With Method Three, computa- 
tion tme was further reduced by: 


1. Eliminating decision variables for those time periods the searcher and evader can- 
not comeie, 


2. Using those feasibility constraints of type (16) which contain pél.t) for each time 
period. 
3. Using those feasibility constraints of type (16) which contain ptn.t) for the final few 


tume periods. 


Eliminating the first few tme periods in the one-dimensional CSEG reduces the number 
of variables by approximately one-third. The number of constraints is also reduced by 
one-third. 

Method Three proves to be a faster solution method than the formulation of Eagle 
and Washburn. The use of just left- and right-anchored constraints for motion feasibil- 


itv constraints 1s eflective for n < 30. 


B. RECOMMENDATIONS 
The time required to solve CSEGs on the order of n= 30 still remains verv large even 
with the reduction achieved with Method Three. Further reduction mav be possible 


through the elimination of more variables or constraints. 
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In Methods Two and Three, all type (26) constraints are used. It may be possible 
to identify and eliminate those constraints which are always slack. Previously mentioned 
was the tendency of neighboring p(i.t) and q(i.t) values to be equal. The number of 
variables may be further reduced if the game can be modeled using pairs or groups of 
cells as decision variables. Extension of Model Three to the two-dimensional game 
should be attempted. The two dimensional CSEG would more closely model the real 
aspects of physical search than the one dimensional game. The solutions to CSEGs are 
very structured and there may be more ways of exploiting their characteristics to solve 


larger games more quickly. 











APPENDIX GAMS PROGRAM OF METHOD THREE 


STITLE One-dimensional CSEG written by LT B.P. Bothwell March 1990 
SONTEXT 

This model uses the LP presented as Method Three. It has been 

proven to solve CSEGs up to a size of n=30. The dimensions of the set I 
(cells) is equal to n. The dimension of the set T (time) is n+l where 
t=FIRST, FIRST+1,...,INT(1.5n)+1 where FIRST = the first time period in 
which the searcher and evader may first coincide. The model only 
requires the motion feasibility constraints of level n-2 and lower. For 
example, if n=12, it is only necessary to include FEAS1 through FEAS10 
and RFEAS1 through RFEAS10. If it is desired to solve a CSEG of size 
n>30, additional FEAS and RFEAS constraints must be added. The program 
displays searcher and evader marginal probabilities, game values, and 
minimum and maximum possible pavoff (z,ze) values. 

SOFFTEXT 

SOFFSYMXREF OFFSYMLIST OFFUELLIST OFFUELXREF 

OPTIONS LIMROW=0 , LIMCOL=0 , SOLPRINT=OFF , RESLIM=3000, ITERLIM=12000 

OPTION LP=MINOS5; 


SETS 
I cells /C1*C12/ 
T time periods /T7*T19/; 
ALIAS (1,J); 
PARAMETERS 
FIRST first non-trivial time period 
ULTRA first time period for right-handed constraints ; 
SONTEXT 


FIRST must be set to the first time period in which the searcher and 
evader can coincide. 

ULTRA is the first time period in which right-anchored constraints 
are used. It is currently set to write these constraints for the last 
four time periods. s 


SOFFTEXT 


3] 

















FIRST=7; 
ULTRA=CARD(T)+FIRST-4; 
POSITIVE VARIABLES 


P(I,T) searcher marginal distn in cell i at time t 
Z(1,T) min value obtainable from t to T given evader in i at t; 
SONTEXT 


P(i,t) is fixed at zero if it is infeasible for the searcher 


to reach that cell 


SOFFTEXT 
P.FX(I,T)$CORD(I) GT ORD(T)+FIRST-1) = 0; 
VARIABLE 
V game value; 
SONTEXT 


Equation description 


GAMEVAL constraints ensure v < 2(i,t) for i > FIRST-1 and t = FIRST 
DIST* constraints ensure p(1,t)+p(2,t)+...t+p(n,t)=1 for t>FIRST 
NET* constraints ensure 2(i,t) < z(j,t+l) + p(i,t) for i inC, 
j in ECi,t) and t=FIRST,...,CARD(T)-1 
FEASa constraints ensure p(1,t)+...+p(a,t) < p(1,t-1)+...+pCatl,t-1) 
for a=l],...,n-2 and t > FIRST+1 
RFEASa constraints ensure p(n,t)+...+p(ntl-a,t) < p(n,t-1)+...+p(n-a,t-1) 
for a=l,...,n-2 and t > FIRST+1 


SOFFTEXT 

EQUATIONS 
GAMEVAL(CI,T) game value constraints 
DISTONEC(T) inequality distn constraints 
DISTTWO(T) equality distn constraint-final time period 
NETL(I,T) intermediate network constraint type l 
NETE(1,T) intermediate network constraint type e 
NETM(1,T) intermediate network constraint type m 
FEAS1(T) feasibility constraints for searcher marginals 
RFEAS1(T) 
FEAS2(T) 














RFEAS2(T) 
FEAS3(T) 
RFEAS3(T) 
FEAS4(T) 
RFEASS(T) 
FEASS(T) 
RFEASS(T) 
FEAS6(T) 
RFEAS6(T) 
FEAS7(T) 
RFEAS7(T) 
FEAS8(T) 
RFEASS(T) 
FEAS9(T) 
RFEAS9(T) 
FEAS10(T) 
RFEAS10(T) 
FEAS11(T) 
RFEAS11(T) 
FEAS12(T) 
RFEAS12(T) 
FEAS13(T) 
RFEAS13(T) 
FEAS14(T) 
RFEAS14(T) 
FEAS15(T) 
RFEAS15(T) 
FEAS16(T) 
RFEAS 16(T) 
FEAS17(T) 
RFEAS17(T) 
FEAS18(T) 
RFEAS18(T); 


SONTEXT 











FEAS19(T) 

RFEAS19(T) 

FEAS20(T) 

RFEAS20(T) 

FEAS21(T) 

RFEAS21(T) 

FEAS22(T) 

RFEAS22(T) 

FEAS23(T) 

RFEAS23(T) 

FEAS24(T) 

RFEAS24(T) 

FEAS25(T) 

RFEAS25(T) 

FEAS26¢(T) 

RFEAS26(T) 

FEAS27(T) 

RFEAS27(T) 

FEAS28(T) 

RFEAS28(T) ; 
SOFFTEXT 
GAMEVAL(1,T)S$C((ORD(1) GE FIRST~1) AND (ORD(T) EQ 1)). 

VY =L= Z(1,T) ; 
DISTONE(T)S$CORD(T) LT CARD(T)).. 

SUM(I,P(I,T)) =L= 100 ; 
DISTTWO(T)S(CORD(T) EQ CARD(T)).. 

SUMCI,PCI,T)) =E= 100 ; 
NETL(I,T)S$CORDCI) GT 1).. 

Z(1,T) =L= Z(1-1,T+1) + PCI,.2) ; 
NETEC(I,T).. 

Z(1,T) =L= Z(1,T+1) + PCI,T) ; 
NETM(1,T)$CORDCI) LT CARD(I)).. 

Z2(1,T) =L= Z2(1+1,T+1) + PCI,T) ; 
FEAS1(T)S$C(CORD(T) GE 2) AND (ORD(T) LT CARD(T))). 


a4 











SUM(IS(ORD(I) EQ 1),P(I,T)) =L= SU 
FEAS2(T)$((ORD(T) GE 2) AND (ORD(T) LT 


S'M(1$CORD(1) LE 2),P(1,T)) =L= SU! 


MC JSCORD(J) LE 
CARD(T))).. 


M(JSCORD(J) LE 


FEAS3( T)$((ORD(T) GE 2) AND (ORD(T) LT CARD(T))).. 


SUMCISCORD(I) LE 3),PCI,T)) =L= SUM(J$(CORD(J) 


LE 


FEASS(T)$((ORD(T) GE 2) AND (ORD(T) LT CARD(T))).. 


SUMCISCORD(1) LE 4),P(1,T)) =L= SUMCJSCORD(J) 


LE 


FEASS(T)S(CORD(T) GE 2) AND (ORD(T) LT CARD(T))).. 


SUN(IS(ORD(I) LE 5),P(1I,T)) =L= SUM(JS(ORD(J) 
CARD(T))).. 


FEAS6(T)S((ORD(T) GE 2) AND (ORD(T) LT 
SUMCISCCORD( IT) LE 6)),PC1,T)) =L= 
FEAS/(T)S$(CORD(T) GE 2) AND (ORD(T) LT 
SUMCISCCORDCI) LE 7)),PCI,T)) =L= 
FEAS8(T)S((ORD(T) GE 2) AND (ORD(T) LT 
SUNCISCCORD(T) LE 8)),P(1I,T)) =L= 
FEAS9(T)$(CORD(T) Ge 2) AND (ORD(T) LT 
SUNCIS(CORD(I) LE 9)),P(I,T)} =L= 
FEAS10(T)$C(ORD(T) GE 2) AND (ORD(T) LT 
SUMCIS((ORD(I) LE 10)),P(I,T)) =L= 
FEAS11(T)S((ORD(T) GE 2) AND (ORDC(T) LT 
SUMCISCCORD( I) LE 11)),PC1,T)) =L= 
FEAS12(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUMCIS(CORD(I) LE 12)),P(1,T)) =L= 
FEAS13(T)SC(CORD(T) GE 2) AND (ORD(T) LT 
SUNCISCCORD(J) LE 13)),P(1,T)) =L= 
FEAS14(T)S$((ORD(T) GE 2) AND (ORD(T) LT 
SUMCISCCORD(I) LE 14)),P(1I,T)) =L= 
FEAS15(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUMCISC(ORD(I) LE 15)),PC(1,T)) =L= 
FEAS16(T)S$(CORDCT) GE 2) AND (ORD(T) LT 
SUMCIS((ORD(1) LE 16)),P(1,T)) =L= 
FEAS17(T)$(CORD(T) GE 2) AND (ORD(T) LT 
SUM(ISCCORD(1) LE 17)),PC(1,T)) =L= 
FEAS18(T)S((ORD(T) GE 2) AND (ORD(T) LT 


LE 


SUMCIS((ORD( J) 
CARD(T))). 
SUM( J$((ORD( 3) 


CARD(T))).. 


SUMC JISC CORD(J) 


CARD(T))).. 





4), 


5) 


6), 


P(J,T-1)) ; 


P(J,T-1)) ; 


P(J,T-1)) ; 


POS sTe2)) 3 


P(J,T-1)) ; 


LE 7)),PCJ,T-1)) ; 


LE<6)) 5 PCS, FS). 3 


LE Bad Gd Te1) S 


SUM(JSC(CORD(J) LE 10)),P(J,T-1)); 


CARD(T))). 


SUM(JS((ORD(J) LE 11)),P(J,T-1)); 


CARD(T))).. 
SUMC JSC CORD(C J) 
CARD(T))). 
SUM(J$( CORD( J) 
CARD(T))). 
SUM( J$( CORD( J) 
CARD(7))).. 
SUM( JS(CORDC J) 
CARD(T))).. 
SUMC I$ (CORD( J) 
CARD(T))).. 
SUM( JSC CORD( J) 
CARD(T))).. 
SUM( J$( (ORD( J) 
CARD(T))).. 


LE 


LE 


LE 


LE 


LE 


LE 


LE 


12)),P(J,T-1)); 


13)),PCJ,T-1)); 


14)),PCJ,T-1)); 


15)),PCJ,T-1)); 


16)),P(J,T-1)); 


17)),P(J,T-1)); 





SUM(IS((ORD(1) LE 18)),P(I,T)) =L= 
SONTEXT 
FEAS19(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUMCIS((ORD(I) LE 19)),PC(I,T)) =L= 
FEAS2C(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUM(IS((ORD(I) LE 20)),P(I,T)) =L= 
FEAS21(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUM(IS((ORD(1) LE 21)),P(I,T)) =L= 
FEAS22(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUMCIS(CORD(I) LE 22)),P(I,T)) =L= 
FEAS23(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUM(IS((ORD(I) LE 23)),P(I,T)) =L= 
FEAS24(T)S((ORD(T) GE 2) AND (ORD(T) LT 
SUM(IS((ORD(I) LE 24)),P(I,T)) =L= 
FEAS25(T)S$((ORD(T) GE 2) AND (ORD(T) LT 
SUM(1S((ORD(I) LE 25)),P(1,T)) =L= 
FEAS26(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUM(IS((ORD(1) LE 26)),P(I,T)) =L= 
FEAS27(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUNCIS((ORD(I) LE 27)),PC(I,T)) =L= 
FEAS28(T)$((ORD(T) GE 2) AND (ORD(T) LT 
SUM(IS((ORD(1) LE 28)),PCI,T)) =L= 
SOFFTEXT 
RFEAS1(T)$(ORD(T) GE ULTRA).. 
SUMCISCORD(1) EQ CARD(I)),PC(I,T)) 


SUM( J$( CORD( J) 


CARD(T))).. 
SUMC JSC CORD( J) 
CARD(T))).. 
SUMC J$CCORD(J) 
CARD(T))).. 
SUMC J$(CORD( J) 
CARD(T))).. 
SUMCJ$(CORD( J) 
CARD(T))).. 
SUM(J$( (ORD( J) 
CARD(T))).. 
SUM( JSC CORD( J) 
CARD(T))).. 
SUM(J$( (ORD( J) 
CARD(T))).. 
SUMC J$(CORD( J) 
CARD(T))).. 
SUM(J$((CORD( J) 
CARD(T)))... 
SUMCJ$(CORD( J) 


tt 


L= 


SUNCJS(ORD(J) GE CARD(J)-1),P(J,T-1)) ; 
RFEAS2(T)$(ORD(T) GE ULTRA}.. 
SUM(ISCORD(I) GE CARD(I)-1),P(1,T)) =L= 
SUM( J$CORD(J) GE CARD(J)-2),P(J,T-1)) ; 
RFEAS3(T)$(ORD(T) GE ULTRA).. 
SUMCIS(ORD(I) GE CARD(1)-2),P(1,T)) =L= 
SUM(JSC(ORD(J) GE CARD(J)-3),P(J,T-1)) ; 
RFEAS4(T)$(ORD(T) GE ULTRA).. 
SUMCIS(ORD(I) GE CARD(1)-3),P(1,T)) =L= 





LE 


LE 


LE 


LE 


LE 


LE 


LE 


LE 


LE 


LE 


19)),P(J,T-1)); 


21)),P(J,T-1)); 


22)),P(J,T-1)); 


23)),P(J,T-1)); 


“4)),P(J,T-1)); 


25)),P(J,T-1)); 


26)),P(J,T-1)); 


27)),P(J,T-1)); 


28)),P(J,T-1)); 











SUM(J$(ORD(J) GE CARD(J)-4),P(J,T-1)) ; 


RFEAS5(T)$(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(I)-4),P(1,T)) =L= 


SUM(JSCORD(J) GE CARD(J)-5),P(J,T-1)) ; 


RFEAS6(T)S(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(I)-5),P(1,T)) =L= 


SUM(JSCORD(J) GE CARD(J)-6),P(J,T-1)) ; 


RFEAS7(T)S(CORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(1)-6),P(1I,T)) =L= 


SUMCJSCORD(J) GE CARD(J)-7),P(J,T-1)) ; 


RFEAS8(T)$(ORD(T) GE ULTRA).. 
SUMCISCORD(1) GE CARD(1I)-7),P(1,T)) =L= 


SUMCJSCORD(J) GE CARD(J)-8),P(J,T-1)) ; 


RFEAS9(T)SCORD(T) GE ULTRA).. 
SUMCIS(ORD(I) GE CARD(1)-8),PC(I,T)) =L= 


SUMCJSCORD(J) GE CARD(J)-9),P(J,T-1)) ; 


RFEAS10(T)$(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(1)-9),P(1,T)) =L= 


SUMCJSCORD(J) GE CARD(J)-10),P(J,T-1)) ; 


RFEAS11(T)$(ORD(T) GE ULTRA).. 
SUMCISCORD(1) GE CARD(1I)-10),P(I,T)) =L= 


SUMCJSCORD(J) GE CARD(J)-11),P(J,T-1)) 


RFEAS12(T)$CORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(1)-11),P(1,T)) =L= 


SUM(JSCORD(J) GE CARD(J)-12),P(J,T-1)) 


RFEAS13(T)S(ORD(T) GE ULTRA).. 
SUMCIS(ORD(1) GE CARD(I)-12),P(1,T)) =L= 


SUM(JSCORD(J) GE CARD(J)-13),P(J,T-1)) 


RFEAS14(T)$(ORD(T) GE ULTRA).. 
SUMCI$CORD(I) GE CARD(1I)-13),P(I,T)) =L= 


SUM(JSCORD(J) GE CARD(J)-14),P(J,T-1)) ; 


RFEAS15(T)$(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(1I)-14),P(I,T)) =L= 





> 


2 


> 


> 


> 





SUM(JS(ORD(J) GE CARD(J)-15),P(J,T-1)) ; 
RFEAS16(T)$(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(I)-15),P(1,T)) =L= 





SUM( JSCORD(J) GE CARD(J)-16),P(J,T-1)) 


RFEAS17(T)$C(ORD(T) GE ULTRA). 
SUM(ISCORD(I) GE CARD(1)-16),P(1I,T)) = 


SUM( JSCORD(J) GE CARD(J)-17),P(J,T-1)) ; 


RFEAS18(T)S(ORD(T) GE ULTRA).. 
SUMCIS(ORD(1) GE CARD(I)-17),P(1,T)) =L= 
SUM(JSCORD(J) GE CARD(J)-18),P(J,T-1)) ; 
SONTEXT 
RFEAS19(T)S(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(1I)-18),PC(1,T)) =L= 
SUM(JS(ORD(J) GE CARD(J)-19),P(J,T-1)) ; 
RFEAS20(T)$(ORD(T) GE ULTRA). 
SUM(IS(ORD(I) GE CARD(1I)-19),P(1I,T)) =L= 
SUM(JS(ORD(J) GE CARD(J)-20),P(J,T-1)) ; 
RFEAS21(T)$C(ORD(T) GE ULTRA).. 
SUM(IS(ORD(I) GE CARD(1)-20),P(I,T)) =L= 
SUM(JS(ORD(J) GE CARD(J)-21),P(J,T-1)) ; 
RFEAS22(T)S(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(1)-21),P(1,T)) =L= 


SUM(JSCORD(J) GE CARD(J)-22),P(J,T-1)) 


RFEAS23(T)S$C(ORD(T) GE ULTRA).. 
SUMCISCORD(I) GE CARD(I)-22),PC1,T)) =L= 





SUM(J$(ORD(J) GE CARD(J)-23),P(J,T-1)) ; 


RFEAS24(T)$(ORD(T) GE ULTRA).. 
SUMCIS(ORD(I) GE CARD(I)-23),P(1,T)) =L= 


SUM(JS$(ORD(J) GE CARD(J)-24),P(J,T-1)) ; 


RFEAS25(T)$CORD(T) GE ULTRA).. 
SUMCISC(ORD(I) GE CARD(1)-24),P(1I,T)) =L= 
SUM(JS(ORD(J) GE CARD(J)-25),P(J,T-1)) 
RFEAS26(T)$(ORD(T) GE ULTRA).. 
SUM(IS(ORD(1I) GE CARD(1)-25),P(1,T)) =L= 


38 














SUM(JSCORD(J) GE CARD(J)-26),P(J,T-1)) ; 
RFEAS27(T)SCORD(T) GE ULTRA). 
SUMCISCORD( I) GE CARD(1I)-26),P(1,T)) =L= 
SUM(CJSCORD(J) GE CARD(J)-27),P(J,T-1)) ; 
RFEAS28(T)S$(ORD(T) GE ULTRA).. 
SUMCISCORD(1) GE CARD(1)-27),PC(1,T)) =L= 
SUMCJSCORD(J) GE CARD(J)-28),P(J,T-1)) ; 
SOFFTEXT 
MODEL CSEG /ALL/ ; 
SOLVE CSEG USING LP MAXIMIZING V ; 
SONTEXT 
DISPLAY statements show values of p, v and z in LP solution 
SOFFTEXT 
DISPLAY P.L ; 
DISPLAY V.L ; 
DISPLAY Z.L ; 
SONTEXT 
q(i,t) solution comes from dual - network equation slack values 
SOFFTEAT 
PARAMETER 
QC1,T) evader marginals; 
QUI,T) = 100*(NETL. MCI ,T)+NETE. MCI,T)+NETM.M(1,T)); 
DISPLAY Q ; 
SONTEXT 
u(i,t) computes the maximum score obtainable to the searcher if 
he is in cell i and evader marginals are given 
SOFFTEXT 
PARAMETER 





ZE(1,T) longest path by searcher; 
ALIAS (T,TP); 
ZEC(I,T)$CORD(T) EQ 1)=SUM(TPS(ORD(TP) EQ CARD(T)),QC1,TP)) 
LOOP(TS(ORD(T) LT CARD(T)),ZE(1,T+1)=SUM(TPS(ORD(TP)+ORD(T) EQ CARD(T)), 
QCI,TP))+MAX(ZE(1-1,T),ZE(1,T),ZECI+1,T))); 


DISPLAY ZE; 
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